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A global analysis of atmospheric and reactor neutrino data is presented in terms of three-neutrino oscillations. 
We consider in our analysis both contained events and upward-going !/-induced muon events, including the previous 
data samples of Frejus, 1MB, Nusex, and Kamioka experiments as well as the full 71 kton-yr (1144 days) Super- 
Kamiokande data set, the recent 5.1 kton-yr contained events of Soudan-2 and the results on upgoing muons 
from the MACRO detector. After presenting the results for the analysis of atmospheric data alone, we add to 
our data sample the reactor bound of the CHOOZ experiment, showing and important complementarity between 
the atmospheric and reactor limits which results in a stronger constraint on the allowed value of #13. 



1. Introduction 

Super-Kamiokande high statistics data |1I2| in- 
dicate a clear deficit in the f M atmospheric events, 
while u e events appear to be in good agreement 
with the Standard Model (SM) prediction. Nowa- 
days, the present status of two-family oscillations 
clearly favour the — > v r channel, while the 
— > v e scenario is finally excluded pQ; this be- 
haviour is also strengthened by the recent results 
of reactor experiments However, a complete 
understanding of the phenomenological picture 
emerging from the atmospheric neutrino data re- 
quire to investigate the whole three-neutrino pa- 
rameter space. 

In this paper we present a global analysis of 
atmospheric and reactor neutrino data in terms 
of three-family neutrino oscillations. We in- 
clude in our analysis all the contained events as 
well as the upward-going neutrino-induced muon 
fluxes, including both the previous data samples 
of Frejus @|, 1MB [5], Nusex and Kamioka 
experiments and the full 71 kton-yr Super- 
Kamiokande data set the recent 5.1 kton-yr 
contained events of Soudan-2 jS] and the results 
on upgoing muons from the MACRO detector [§]. 
We also determine the constraints implied by the 
CHOOZ reactor experiments 0- 

In Sec. El we give a brief introduction to the at- 
mospheric neutrino problem, describing the data 
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samples, the statistical analysis and the theoreti- 
cal calculation of the conversion probabilities for 
atmospheric and reactor neutrinos in the frame- 
work of three-neutrino mixing. In Sec. |3|we de- 
scribe our results for atmospheric neutrino fits, 
both by themselves and also in combination with 
the reactor data. Finally in Sec. 01 we summarize 
the work and present our conclusions. 



2. Data samples and statistical analysis 

Underground experiments can record atmo- 
spheric neutrinos both by direct observation of 
their interactions inside the detector (the so- 
called contained events), and by indirect detec- 
tion of the muons produced by charged current in- 
teractions in the vicinity of the detector (upgoing- 
muons events). 

Contained events have been recorded at six 
underground experiments, using either water- 
Cerenkov detectors (Kamiokande 0, 1MB 
and Super-Kamiokande 0) or iron calorimeters 
(Frejus @J, NUSEX © and Soudan-2 jEJ). For 
Kamiokande and Super-Kamiokande, the con- 
tained data sample is further divided into sub- 
GeV events, with visible energy below 1.2 GeV, 
and multi-GeV events, with lepton energy above 
this cutoff. Sub-GeV events arise from neutri- 
nos of several hundreds of MeV, while multi-GeV 
events are originated by neutrinos with energies 
of several GeV. 



2 



Concerning upgoing muons events, in our anal- 
ysis we considered the latest results from Super- 
Kamiokande [2] and from the MACRO ^ exper- 
iment. For Super-Kamiokande, the data sam- 
ple is further divided into stopping muons, if 
the muon stops inside the detector, and through- 
going muons, if the muon track crosses the full 
detector; for the MACRO experiment, we only 
considered through-going events. On average, 
stopping muons arise from neutrinos with ener- 
gies around ten GeV, while through-going muons 
are originated by neutrinos with energies around 
hundred GeV. 

In order to study the results for the dif- 
ferent types of atmospheric neutrino data, we 
have defined the following combinations of data 
sets: 

• FINKS (10 points): the e-like and /z-like event 
rates from the five experiments Frejus, 1MB, 
Nusex, Kamiokande sub-GeV and Soudan-2; 

• CONT-UNBIN (16 points): the rates in 
FINKS together with Kamiokande multi-GeV 
and Super-Kamiokande sub- and multi-GeV e- 
like and /^-like event rates, without including 
the angular information; 

• CONT-BIN (40 points): same as CONT- 
UNBIN, but also including the angular infor- 
mation (5 angular bins) for Kamiokande multi- 
GeV and SK sub- and multi-GeV. 

• \JP-fi (25 points): muon fluxes for stopping 
(5 angular bins) and through-going (10 bins) 
muons at Super-Kamiokande and MACRO; 

• SK (35 points): the full Super-Kamiokande 
data sample (both contained and through- 
going events); 

• ALL- ATM (65 points): the full data sample of 
all atmospheric neutrino data. 

For each of these combinations we have performed 
a x 2 analysis by computing the % 2 as a function 
of the neutrino oscillation parameters. Following 
closely the analysis of Refs. |l()lll| , we have used 
the actual number of e-like and /i— like events, 
rather than just their ratios, paying attention 
both to the correlations between the sources of 



errors in the muon and electron predictions and 
to those amongst the errors of different energy 
data samples. Thus we define x 2 as 

x 2 = AN i ■ (°U + °th) u - an j> w 

I,J 

ajj = a a (A)p a[} (A,B)a f3 (B). (2) 

where ATVj = N"j xp ~ Nj h , Nj h being the pre- 
dicted number of events (or the predicted value 
of the flux, in the case of upgoing muons) and 
Nj Xp the corresponding experimental measure- 
ment. Here /, J stand for any combination of ex- 
perimental data sets and event-types considered, 
i.e. I = (A, a) and J = (B,f3) where A, B la- 
bel the different data samples and a, [3 denote the 
flavour of the final lepton. Finally, ajj is the error 
matrix containing the theoretical/experimental 
errors, p a /3(A,B) is the correlation matrix and 
cr a (A) is the theoretical/experimental error for 
the number of a-like events in the A experiment. 
A detailed discussion of the errors and correla- 
tions used in our analysis can be found in Ref . P , 
as well as in the appendices of Refs. ^HIi both for 
contained and for the upgoing muon data analy- 
sis. 

In general, the determination of the oscil- 
lation probabilities require the solution of the 
Schroedinger evolution equation of the neutrino 
system in the Earth-matter background. For a 
CP-conserving three-flavour scenario, this equa- 
tion reads 

i^ = Hi7, H = R-H^-Rt+V, (3) 

where v = (i/ e , v^, v T ), R is the orthogonal matrix 
connecting the flavour basis and the mass basis 
in vacuum, Hq is the vacuum Hamiltonian and 

V describes charged-current forward interactions 
in matter: 

H " = 2^: diag ( ~ Am21 ' °' Am ' 2) ' (4) 

V = diag (±V2G F A e ,0,o) . (5) 

In general, the neutrino transition probabilities 
depend on five parameters, namely the two mass- 
squared differences Amfi, Am| 2 and the three 
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mixing angles #12, 6*13, #23, however in order to 
accommodate both solar and atmospheric neu- 
trino data into a unified framework an hierarchy 
between Am^i and Am| 2 is required: 

Ami, = Am 2 i ] „ „ 

kAm^«AmL. (6) 

Am at m = Am 32 J 

As a consequence, for what concerns the analysis 
of atmospheric neutrino events it is safe to set 
Am^ = 0, in which case the angle 9±2 also cancels 
out and the matrix R can be written as: 

/ C13 S13 \ 

R = -S23S13 C23 S23C13 • (7) 
V-S13C23 -S23 C23C13/ 

where = cosdjj and Sy = sindjj. As a result, 
the 3^ propagation of atmospheric neutrinos can 
be well described in terms of only three parame- 
ters: Am§ 2 , #23 and #13. 

When 0i3 = 0, atmospheric neutrinos involve 
only — > ^ T conversions, and in this case there 
are no matter effects, so that the solution of 
Eq. is straightforward and the survival prob- 
ability takes the well-known vacuum form 

P w = l-sin 2 (2Msin 2 (^|^), (8) 

where L is the path-length traveled by neutrinos 
of energy E v . On the other hand, in the gen- 
eral case of three-neutrino scenario with 6*i 3 ^ 
the presence of the matter potentials requires a 
numerical solution of the evolution equations in 
order to obtain the oscillation probabilities for at- 
mospheric neutrinos P^p, which are different for 
neutrinos and anti-neutrinos because of the rever- 
sal of sign in Eq. J5J. In our calculations, we have 
used for the matter density profile of the Earth 
the approximate analytic parameterization of the 
PREM model given in Ref. Q21. 

The CHOOZ experiment [Sj searches for disap- 
pearance of v e produced in a power station with 
two pressurized- water nuclear reactors with a to- 
tal thermal power of 8.5 GW (thermal). At the 
detector, located at L ~ 1 Km from the reactors, 
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Figure 1. Excluded region (90, 95, 99% CL) in 
Am| 2 and tan 2 #13 from the non observation of 
oscillations by the CHOOZ reactor experiment. 

the v e reaction signature is the delayed coinci- 
dence between the prompt e + signal and the sig- 
nal due to the neutron capture in the Gd-loaded 
scintillator. Since no evidence was found for a 
deficit of measured vs. expected neutrino interac- 
tions, the result of this experiment is a bound on 
the oscillation parameters describing the mixing 
of v e with all the other neutrino species. Un- 
der the assumption Am 2 ! ~ 0, the only relevant 
parameters are #13 and Amjj ~ Amf^, and in 
Fig. ^ we show the exclusion plot in this plane. 
From this figure we see that at 99% CL the region 
Amf 2 > 1CT 3 eV 2 and 0.044 < tan 2 13 < 23 is 
excluded. 

3. Results of the analysis 

The first result of our analysis refers to the 
no-oscillation hypothesis. As can be seen from 
the fifth column of Table the x 2 values in 
the absence of new physics clearly show that 
the experimental data are totally inconsistent 
with the SM hypothesis; in fact, the global 
analysis (ALL-ATM combination) gives Xsm = 
191.7/(65 d.o.f.), corresponding to a probability 
< 10 -14 . This result is rather insensitive to the 
inclusion of the CHOOZ reactor data, as can be 
seen from the last line of Table ^ Therefore, 
the Standard Model can be safely ruled out. In 
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Table 1 



Minimum \ 2 values and best-fit points for various sets of atmospheric neutrino data. 
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contrast, the % 2 for the global analysis decreases 
to 61.7/(62 d.o.f.) (or 62.5/(63 d.o.f.) including 
CHOOZ), acceptable at the 51% CL, when os- 
cillations are assumed. 

Tabled also gives the minimum \ 2 values and 
the resulting best-fit points for the various com- 
binations of data sets considered. Note that for 
FINKS, CONT-UNBIN and UP-^ combinations 
the best-fit point is characterized by a rather 
large value of tan 2 6*13 , while all the other data 
set favour a value very close to 0. The corre- 
sponding allowed regions in the (tan 2 #23, Am 2 ^) 
plane at 90, 95 and 99% CL for the different com- 
binations are depicted in Figs. [21 and [3J Note 
that the value tan 2 #13 = corresponds to pure 

— ► v T oscillations, and in this case the contour 
regions are symmetric under the transformation 
#23 — * vr/4 — 6*23 due to the cancellation of matter 
effects (cfr. Eq.0. 

In Fig. [5] we present the allowed regions in 
(tan 2 6*23, Am§ 2 ) for different values of tan 2 #13, 
for the FINKS and CONT-UNBIN combinations. 



It is evident that, despite of the large statistics 
provided by Super-Kamiokande, it is not possi- 
ble from the information on the total event rates 
only (i.e. without taking into account the angular 
dependence) to place any upper bound on Ato§ 2 , 
and even the lower bound Am| 2 > 2 x 10 -4 eV 2 
is rather weak. Moreover, none of the sets can 
provide a relevant constraint neither on tan 2 $13 
nor on tan 2 6*23 ■ 

Conversely, in Fig. we display the allowed 
regions in (tan 2 $23, Am| 2 ) for the combinations 
CONT-BIN, UP-/Z and ALL-ATM, which also 
include the information on the angular distribu- 
tion of the incoming neutrinos. For what concerns 
contained events (CONT-BIN), let us note that 
the upper bound on Am^ is now rather strong 
(better than 10 -2 eV 2 ) as a consequence of the 
fact that no suppression for downgoing neutri- 
nos is observed. This imposes a lower bound on 
the neutrino oscillation length and consequently 
an upper bound on the mass difference. How- 
ever contained events alone still allow values of 
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Figure 2. Allowed regions (90, 95, 99% CL) in 
tan 2 023 and Am| 2 , for different tan 2 #13 values, 
for the FINKS and CONT-UNBIN combinations. 



Am 2 2 < 1CT 3 eV 2 . Note also that the allowed 
region is still rather large for tan 2 6*13 w 0.7 and 
at 99% CL it only disappears for tan 2 #13 ~ 2.4. 

This situation is completely reversed when con- 
sidering upgoing muon events (UP— fi) . This com- 
bination is complementary to CONT-BIN, in the 
sense that the corresponding data sets are com- 
pletely disjoint. In contrast to the CONT-BIN 
case, now the upper bound on Am 2 2 is much 
weaker («3x 10 -2 eV 2 ), while the lower bound 
is now stronger. Again, no relevant bound can 
be put on #13 from the analysis of upgoing events 
alone. 

Due to the complementarity between the prop- 
erties of the CONT-BIN and UP-/i combinations, 
merging them into a single data set leads to much 
stronger constraints on the parameter space. In 
the lower panel of Fig. [3] we show the allowed re- 
gions in (tan 2 623, Am 2 2 ) from the combined anal- 
ysis of all the atmospheric neutrino data (ALL- 
ATM). Due to the large statistics provided by the 
Super-Kamiokande experiment, Am 2 2 is strongly 
bounded both from above and from below. More- 
over no region of parameter space is allowed (even 
at 99% CL) for tan 2 9 13 > 0.6; therefore, this 
limit can be considered as the strongest bound 
which can be put on tan 2 #13 from the analysis of 
atmospheric events alone. 

All these features can be more quantitatively 
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Figure 3. Allowed regions (90, 95, 99% CL) in 
tan 2 023 and Am§ 2 , for different tan 2 813 values, 
for the CONT-BIN, UP-£t and ATM-ALL com- 
binations. 



observed in Fig.^J where we show the dependence 
of A% 2 on tan 2 #13 and Ato| 2 , for the different 
combination of atmospheric neutrino events. In 
these plots all the neutrino oscillation parameters 
which are not displayed have been "integrated 
out" , i. e. the displayed A^ 2 is minimized with 
respect to all the non-displayed variables. From 
the left panels of Fig. 0] we can read the upper 
bound on tan 2 O13 that can be extracted from the 
analysis of the different samples of atmospheric 
data alone regardless of the values of the other pa- 
rameters of the three-neutrino mixing matrix; the 
corresponding 90 and 99% CL bounds are sum- 
marized in Table El Conversely, from the right 
panels of Fig. 21 we extract the value of Arn 2 2 al- 
lowed by the different combinations, irrespective 
of the values of the other mixing parameters. 

In order to illustrate the main effect of vary- 
ing the angle #13 in the description of the angular 
distribution of atmospheric neutrino events, we 
show in Fig.[5]thc zenith- angle distribution for the 
Super-Kamiokande experiment. The thick solid 
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Figure 4. Dependence of A% 2 on tan 2 #13 and on 
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for different combinations of atmospheric 



neutrino events (upper panels) and for the com- 
bination ALL-ATM (lower panels, the dashed 
line includes also CHOOZ). The dotted horizon- 
tal lines correspond to 90 and 99% CL. 
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Figure 5. Zenith-angle distributions for Super- 
Kamiokande events. The thick solid line is the 
expected distribution in the SM, while the thin 
one is the prediction for the overall (ALL-ATM) 
best- fit point. The dashed (dotted) histogram 
correspond to the distributions for tan 2 6*13 = 
0.33(0.54), tan 2 6> 23 = 3.0(3.1) and Am| 2 = 
3.3(2.85) x 10~ 3 eV 2 , which are marginally al- 
lowed at 90 (99)% CL. 



line is the expected distribution in the absence 
of oscillation (SM hypothesis), while the thin full 
line represents the prediction for the overall best- 
fit point of the full atmospheric data set (ALL- 
ATM, see also Tabled which occurs at tan 2 #13 = 
0.03. The dashed and dotted histograms cor- 
respond to points which are marginally allowed 
at 90 and 99% CL, respectively, and occur at 
tan 2 6»i 3 = 0.33 and 0.54 (cfr. TableEJ). For each 
such #13 value we choose Am§ 2 and #32 so as 
to minimize the x 2 - Clearly the description of 
the data is excellent as long as the oscillation 
is mainly in the — > v r channel (small #13); 



this is simply understood since it is clear from 
Fig. [5] that e-like contained events are well ac- 
counted for within the no-oscillation hypothesis. 
From this figure we see that increasing tan 2 #13 
leads to an increase in all the contained event 
rates; this is due to the fact that an increasing 
fraction of now oscillates as — > v e (also 
j'e's oscillate as v e — > but since the v e fluxes 
are smaller this effect is relatively less important) 
spoiling the good description of the e-type data, 
especially for upgoing multi-GeV electron events. 
For multi-GeV events all the curves coincide with 
the SM one for downgoing neutrinos which did 
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not have the time to oscillate; this effects is lost 
in the sub-GeV sample due to the large open- 
ing angle between the neutrino and the detected 
lepton. We also see that for multi-GeV electron 
neutrinos the effect of 813 is larger close to the 
vertical (cos 8 = —1) where the expected ratio 
of fluxes in the SM Riy^jv^) is larger. Con- 
versely the relative effect of #13 for is larger 
close to the horizontal direction, cos6> = 0. Con- 
cerning upward-going muons events, we see that 
the effect of adding a large #13 in the expected 
upward muon fluxes is not very significant. For 
stopping muons the effect is larger for neutrinos 
arriving horizontally; this is due, as for the case of 
multi-GeV /i-like contained events, to the larger 
R(i> e /v^) SM flux ratio in this direction which 
implies a larger relative contribution from v e os- 
cillating to v^. This feature is lost in the case 
of through-going muons because it is partly com- 
pensated by the matter effects and also by the 
increase of tan 2 #23 • 

In conclusion we see that the analysis of the 
full atmospheric neutrino data in the framework 
of three-neutrino oscillations clearly favours the 
— > v T oscillation hypothesis. As a matter of 
fact the best-fit corresponds to a small value of 
#13 w 9°, but it still allows for a non-negligible 

— > v e component. More quantitatively we find 
that the ranges of parameters are allowed at 99% 
CL from this analysis are (see also Table |2J: 
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0.57. 



However, one must take into account that these 
ranges are strongly correlated, as clearly visible 
in Fig. 

We now describe the effect of including the 
CHOOZ reactor data together with the at- 
mospheric data samples in a combined three- 



neutrino x 



Am 2 .! 



analysis, 
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under the hypothesis 
< 3 x 10~ 4 eV 2 . The results of this anal- 
ysis are summarized in Figs. 01 and El as well as 
in the last line of Tabs. Q and [21 As already dis- 
cussed, the negative results of the CHOOZ re- 
actor experiment strongly disfavour the region 
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Figure 6. Allowed (tan 2 823, tan 2 6*13) regions for 
different Am| 2 values, for the combination ALL- 
ATM of atmospheric neutrino data and including 
also the CHOOZ result. 



0.044 < tan 2 8 13 < 23 if Am§ 2 > 10" 3 eV 2 , how- 
ever for smaller values of Am§ 2 the corresponding 
bound on #13 is much weaker. Therefore an inde- 
pendent lower bound on Am 2 2 is required for the 
CHOOZ constraint on #13 to be applicable. To 
illustrate this point we show in the upper panels 
of Fig. the allowed regions from the combina- 
tion of the CONT-BIN events with the CHOOZ 
data. Comparing them with the corresponding 
ones from Fig. El we see that, although the re- 
gion Am 2 2 > 10~ 3 eV 2 is ruled out as soon as 813 
deviates from zero, there is still a part of the pa- 
rameter space which survives (at 99% CL) up to 
tan 2 6*i3 w 0.66. Thus, even with the large statis- 
tics provided by the Super-Kamiokande data and 
including the CHOOZ result, it is not possible to 
improve the bound on #13 using only contained 
events. 

The situation is changed once the upgoing 
muon events are included in the analysis. As 
clearly visible from the central panels of Fig. |3 
the UP- fi data sample disfavours the low mass re- 



8 



gion Am§ 2 < 10~ 3 eV 2 . As a result, the full 99% 
CL allowed parameter regions from the global 
analysis of the atmospheric data ALL- ATM lies 
in the mass range where the CHOOZ experiment 
should have observed oscillations for sizeable $13 
values, and this leads to the shift of the global 
minimum from the combined atmospheric plus 
CHOOZ data to #13 sw 0. Thus adding the reactor 
data has as main effect the strong improvement 
of the tan 2 #13 limit, as can also be seen from the 
lower-left panel in Fig. 01 Conversely, from the 
lower-right panel of the same figure we see that 
the allowed range of Arn 2 2 is almost unaffected. 

In conclusion, from the atmospheric and reac- 
tor neutrino combined analysis we get the follow- 
ing 99% CL allowed ranges of parameters: 
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4. Summary and conclusions 

In this article we have presented a global analy- 
sis of both atmospheric and reactor neutrino data 
in terms of three-flavour oscillations. Our re- 
sults show that the most favourable scenario is 
the — ► v T oscillation hypothesis, however from 
the analysis atmospheric data alone it is not pos- 
sible to derive a strong bound on #13, and con- 
sequently a non-negligible — > v e component is 
still allowed. When the CHOOZ data in included 
into the analysis, the bound on #13 is drastically 
improved, and e-like neutrinos completely decou- 
ple from the oscillation picture. Conversely, the 
preferred mixing in the — ► v T channel - de- 
scribed by the angle $23 _ appear to be nearly 
maximal. Together with the result of solar ex- 
periments, which also prefer maximal mixing in 
#12 (although in this case the result is still not 
overwhelming), there seems to be an indication 
that the ultimate structure of neutrino mixing is 
bi-maximal. This result is in puzzling contrast 
with the observed structure of quark mixing, and 
may indicate that the origin of neutrino masses 
is intrinsically different from the standard Higgs 
mechanism which is responsible for the masses of 
the charged leptons in the Standard Model. 
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